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Abstract 

In this paper we give another proof of the fact that a random overlap array, which 
satisfies the Ghirlanda-Guerra identities and whose elements take values in a finite set, 
is ultrametric with probability one. The new proof bypasses random change of density 
invariance principles for directing measures of such arrays and, in addition to the 
Dobvysh-Sudakov representation, is based only on elementary algebraic consequences 
of the Ghirlanda-Guerra identities. 



Key words: spin glasses, Sherrington-Kirkpatrick model, ultrametricity. 
Mathematics Subject Classification: 60K35, 82B44 

1 Introduction and main result. 

In this paper we will give a simplified proof of the main result in [5]. Let us consider an 
infinite random array R = {R^v)i^>i which is symmetric, non-negative definite and weakly 
exchangeable, which means that for any n > 1 and for any permutation p of {l,...,n} 
the matrix (R P (i), P (i'))i,i'<n nas the same distribution as {Ri } v)i t v< n - We assume that diagonal 
elements Rij = 1 and non-diagonal elements take finitely many values, 

F(R 1>2 = q l )= Pl (1.1) 

for some — 1 < q 1 < q 2 <...<%< 1 and pi > 0,pi + . . . + p^ = 1. The array R is said 
to satisfy the Ghirlanda-Guerra identities [I] if for any n > 2 and any bounded measurable 
functions / = f ((Ri,i')i<i,i'<n) and : K -)• R, 

E/V>(i2i,n+i) = ~E/E^(i*i >2 ) • - V A/ri/)',./). (1.2) 
n n ^ — ' 

1=2 

By the positivity principle of Talagrand ([8], [10]), the Ghirlanda-Guerra identities imply 
that Ri 2 > with probability one and, therefore, we can assume that q\ > 0. 
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Theorem 1 (J^) Under assumptions U.l\) and M.fy) , the array R is ultrametric, 



F(R 2>3 >min{R 1>2 ,R 1>3 )) = 1. (1.3) 
Another way to express the event in (jl.3p is to say that 

Ri,2 > Qi, Ri,3 >qi^ R 2 ,3 > qi for all 1 < I < k. (1.4) 

Infinite arrays that satisfy the Ghirlanda-Guerra identities arise as the limits of the overlap 
arrays in the Sherrington-Kirkpatrick spin glass models (see e.g. [10], [7]). The assumption 
(II. ip is purely technical (and unfortunately is not satsified in the most important situations). 
The first ultrametricity result was proved in [2] under different conditions which also included 
( 11. ip . but instead of ( II. 2p the authors worked with the Aizenman-Contucci stochastic stability 
[1] . The original proof of Theorem [1] in [5] utilized a key idea from j2] , namely, the existence 
of directing measures guaranteed by the Dovbysh-Sudakov representation result in [3], and 
we will still rely on this representation here. However, we will completely avoid proving 
any invariance principles under random changes of density for the directing measure, which 
played crucial roles both in [2] and [5] and our new induction will be quite elementary 
in nature. M. Talagrand gave a proof of Theorem [1] in [9J that did not use the Dovbysh- 
Sudakov representation but still used the invariance principle from [5]. The Dovbysh-Sudakov 
representation [3] (for detailed proof see [6]) states that given a symmetric, non- negative 
definite and weakly exchangeable array R, there exists a random measure /i on H x [0, oo), 
where if is a separable Hilbert space, such that R is equal in distribution to the array 

(<r l -a v + a%') M '>i (1.5) 

where (a 1 , a 1 ) is an i.i.d. sequence from fx and a ■ a' denotes the scalar product on H. Let us 
denote by G the marginal of /i on H. The following simple consequence of the Ghirlanda- 
Guerra identities ( II. 2p was proved in Theorem 2 in [5]. 

Proposition 1 Under U.l\) and M.ty) . the random measure G is (countably) discrete and 
is concentrated on the sphere of radius ^Jq~k with probability one. 

In particular, this implies that a — 1 — qj. in (11.51) and without loss of generality we can 
redefine the array by R^i = a 1 ■ a 1 for an i.i.d. sequence (a 1 ) from G. Since Riy = qk if and 
only if a 1 = a 1 , we have 

P(#i,2 = qk, Ri,s = qt, #2,3 < qu) = o, 

which proves "ultrametricity at the level k" in the sense of (II .4p . As in [2] and [5], we would 
like to find a way to make an induction step and prove "ultrametricity at the level k — 1". 
The main new idea of the paper will be to consider the distribution of the array {Rij') condi- 
tionally on the event that all replicas (a 1 ) are different and prove that this new distribution 
is well-defined and satisfies all the conditions of the Dovbysh-Sudakov representation. Since 
on the above event the elements of the new array can not take value qk, the induction step 
will follow. 
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2 Proof. 



By Proposition CD, G = Yli>i w i^i f° r some random weights (wi) and random sequence (^) 
in H such that £i ■ £i = qk- Let us denote by (•) the average with respect to G®°° and by E 
the expectation with respect to the randomness of G. With these notations, the Ghirlanda- 
Guerra identities ( II .2p can be rewritten as 

1 1 - 

E(f n i;(R hn+l )} = -E(/ n )E(^(i?i, 2 )) + -Y t E{M(R lil )). (2.1) 
n n L — ' 

1=2 

For each n > 2, let us consider the event 

A n = {R u > ± q k , VI < I < V < n} (2.2) 

and let P n be the distribution of the n x n matrix R n = {a 1 ■ o l ')i y ii< n conditionally on A n , 

, , E(I(R n e B)I A ) , s 

FJB) = — — ; 2.3 

It is obvious that P n is concentrated on the symmetric non-negative definite matrices with off- 
diagonal elements now taking values {qi, . . . , q k ~i} and F n is invariant under the permutation 
of replica indices since the set A n is. We will now show that P„+i restricted to the first n 
replica coordinates coincides with P„ and, thus, the sequence (P n ) defines a law of the infinite 
overlap array. 

Lemma 1 For any measurable function f of the overlaps on n replicas, 

E(f(R n )I An+l ) = (1 -p k )E{f{R n )I An ). (2.4) 

Proof. Notice that A n = {a 1 , . . . ,o~ n are all different} by Proposition [1] and, therefore, 

Ia u+1 = lA n ~ /jA n n{Ri, n+1 =g k }- (2-5) 

l<n 

This implies that 

E(f(R n )I An+1 ) = E(f(R n )I An ) -Y,W(R n )lAj(Ri,n+i = Qk))- 

l<n 

Using the Ghirlanda-Guerra identities (12.11) . for each I < n, 

E(f(R n )I A J(R lin+1 = q k )) = ^E(f(R n )I An ) + -J2W(R n )lAj(Ri,i'=q k )} 

= ^E(f(R n )I An ) 
n 

since A n C {Ri t i> ^ q k } and, thus, I An I(Ri t ii = q k ) = 0. Adding up over / < n finishes the 
proof. 

□ 
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First, using ( 12. 4p inductively for / = 1 we get E(I An ) = (1 — pk) n 1 and then dividing 
(T22D by (l-p fc ) n gives 

E(f(R")I An+1 ) E(f(R n )I An ) 

E(I An+1 ) E(I An ) ■ 1 • ] 

This means that the family (P n ) is consistent and by Kolmogorov's theorem we can define 
the distribution of the infinite array with the corresponding marginals given by P n . Let us 
consider an array Q = (Qi,i')i,v>i with this distribution. 

Proof of Theorem [JJ. By construction, Q is a symmetric, non-negative definite and 
weakly exchangeable array with diagonal elements equal to qk and off-diagonal elements 
taking values {gi, . . . , qu-i} with probabilities 

P(Qi, 2 = Qi) = j^—. (2.7) 

Using the Dovbysh-Sudakov representation for the array Q implies that there exists a random 
measure G' on H such that Q can be generated as 

Qi,v = o l ■ a 1 ' + 5 hV (q k - a 1 ■ a 1 ) 

for an i.i.d. sequence (a 1 ) from G' . Since a 1 ■ a 1 G {q%, . . . , ?fe-i}, it is easy to see that 
the support of G' must be inside the sphere of radius ^/qu-i for, otherwise, with positive 
probability we could sample two points a 1 , a 2 arbitrarily close to a point a such that ||er|| > 
^qk-i which would contradict that a 1 ■ a 2 < q^-\ (see [2] or [5] for details). In particular, 
the truncated array {Qi,v A qk-\)i,v>\ can be computed as 

Ql,l> A g fe _i = a 1 ■ a 1 ' + Vfe-i - ^ ■ a 1 ) (2.8) 

and it is non-negative definite as the sum of two non-negative definite arrays. If we recall 
the definition (I2.3p . the matrix {Qi^i^Kn is obtained by sampling n configurations from the 
measure G = J2i>i w i$£i conditionally on the event that these configurations are different. 
Since with positive probability we can sample £i,--.,£n> we must have that the matrix 
(6 ■ 6' A qk-i)i,i'<n is non-negative definite and, therefore, (£j ■ A q k -i)i,v>i is non-negative 
definite with probability one. This of course means that (Ri^ Aft-i)i,i'>i is also non-negative 
definite. Since the function x A q k -i can be approximated by polynomials, the truncated 
overlap array also satisfies the Ghirlanda-Guerra identities and its elements now take values 
in {qx, . . . , qk~i}- One can proceed by induction on k. 

□ 

Even though we did not need it in the proof, one can show that the measure G' is actu- 
ally concentrated on the sphere of radius y/qi~i by using Proposition [1] and the following 
observation. 

Lemma 2 The distribution of Q satisfies the Ghirlanda-Guerra identities, 

1 1 n 

E/(Q n )V(Qi, n+ i) = -E/(<7W(Q li2 ) + -£>/(Q n MQi,<). (2.9) 

1=2 
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Proof. For simplicity of notations let us consider the case of if)(x) = x p . Using (12. 5p . 
E(f(R n )Rl n+1 I An+1 ) = E(f(R n )Rl n+1 I An ) -^E(/(i4)^ n+1 / A „ n{ ^„ +1=?fc} > 

Kn 

= E(/( J R n ) J R? iri+1 / A J-^E(/( J R n )^/A„n { i ?i ,„ +1=gfc }). (2.10) 

l<n 

since Ri n +i = q k implies that and, thus, R\, n+ i = Rx,i- By the Ghirlanda-Guerra 

identities, the I th term in the last sum is equal to 

1 n 

|E(/( J R n )^/A„) + -J2 E (f^ R ll I ^n{R ltl ,= qk} ) = ^E(f(R n )RlI An ) 

since A n n {-R/.z' — 9fc} — 0- Similarly, 

1 1 n 

E(f(R n )R p l>n+l I An ) = -E(f(R n )I An )E(Rl 2 ) + -J2W(Rn)Ri l lA n ). 

1=2 

Using that Rn = q k and combining all the terms in (12.101) . E(f(R n )R p n+1 I An+1 ) equals 
- E(f(R n )I An ){E(Rl 2 ) - qlp k ) + Yl nf{Rn)RlM) 

1=2 

1 1 71 

= -E(f(R n )I An )E(Rl 2 I A2 ) + -J2E(f(R n )R p u I An )E(I A2 ). 

1=2 

Recalling that E(/^ n ) = (1 — pfc) n_1 and dividing everything by (1 —pk) n , we get 

E(f(R n )Rj n+l I An+l ) = 1 E(f(R n )I An ) EgA) lA E(J{R^IaJ 
Wa k+1 ) n E(I An ) E(I M ) nj^ E(I An ) 

Comparing with (I2.3p . this is exactly (12. 9p . 

□ 

We would like to point out that the idea of the proof of Theorem [1] suggests the following 
criterion of ultrametricity in the general case without the assumption ( II. ip . Given q £ [0,1] 
such that P(i?i 5 2 < q) > 0, consider the events 

A n , q = {R l)V < q, VI < I < I' < n} (2.11) 

and let F n ^ q be the distribution of R n conditionally on A n . 9 . 

Theorem 2 Under U.fy) . the array R is ultrametric if and only if for any q such that 
P(-Ri,2 < q) > and any set B of 3 x 3 matrices such that F 3)q (R 3 £ B) > we have 
limsup^P^i? 3 £ B) > 0. 

One can check that, in one direction, ultrametricity yields a relationship of the type (12.51) 
which implies the consistency of the sequence (P n ,,j) as in Lemma [1] and F ntQ (R 3 £ B) = 
F 3 ^ q (R 3 £ B). In the other direction, for any B with F 3q (R 3 £ B) > we can choose the 
limit F q over a subsequence of P„ i9 such that P g (-R 3 £ 5) > 0. If ultrametricity fails, one 
can make a choice of a subset of non-ultrametric configurations B and g that will lead to 
contradiction with the Dovbysh-Sudakov representation for F q . 
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